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WE CLAIM: 

1 1. A method for preventing motion/saturation from 

2 corrupting image capturing during a global exposure time of 

3 a sensor, comprising: 

4 performing for each pixel of said sensor: 

5 a) determining a difference between an 

6 illumination measurement obtained during current image 

7 capturing and an illumination estimation generated 

8 during previous image capturing; 

9 b) comparing said difference with a threshold 
Qio value; and 

y|n c) determining, based on step b) , whether 

2Ki2 motion/saturation has occurred. 

The method of claim 1, further comprising: 

dl) accepting said illumination measurement and 
updating said illumination estimation if 
motion/saturation has not occurred; 

d2) updating said illumination estimation with 
said illumination measurement if motion/saturation has 
occurred but terminating said performing act is 
deferred; and 

d3) terminating said performing act and 
outputting said illumination estimation as final 
illumination estimation if motion/saturation has 
occurred. 

1 3. The method of claim 1, wherein said threshold value is 

2 generated based on a predetermined parameter and a 

3 prediction variable, said predetermined parameter is 
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configured to achieve desired tradeoff between signal-to- 
noise ratio and motion blur. 

4. The method of claim 1, wherein said image capturing 
occurs a multiplicity of times during said global exposure 
time thereby producing a multiplicity of measurements and 
wherein an optimal illumination estimation for said sensor 
is generated based on said multiplicity of measurements. 

5. The method of claim 4, wherein said optimal 
illumination estimation is generated based on maximum 
likelihood. 

6. The method of claim 4, wherein said optimal 
illumination estimation is generated based on linear 
minimum mean square error. 

7. The method of claim 1, wherein said image capturing 
occurs a multiplicity of times during said global exposure 
time thereby producing a multiplicity of measurements and 
wherein an optimal illumination estimation for said sensor 
is generated based on selectively accepted multiplicity of 
measurements . 

8. The method of claim 7, wherein said optimal 
illumination estimation is generated based on maximum 
likelihood. 

9. The method of claim 7, wherein said optimal 
illumination estimation is generated based on linear 
minimum mean square error. 

10. The method of claim 1, wherein each pixel's effective 
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2 exposure time is adaptive to its own lighting condition 

3 thereby enabling performing for each pixel independently of 

4 other pixels' lighting conditions. 

1 11. The method of claim 1, wherein each pixel is capable 

2 of terminating its own exposure time thereby enabling 

3 extending said global exposure time. 

1 12. The method of claim 11, wherein said global exposure 

2 time is limited by motion and saturation only thereby 

3 enabling said sensor to achieve higher signal-to-noise 
Q4 ratio and dynamic range. 

13. The method of claim 1, wherein said steps a) -c) are 

111 6 performed based on parameters calculated recursively, said 

ml parameters including said weighting coefficient, overall 

Ms variance, and covariance. 

1 14. The method of claim 1, wherein said steps a)-c) are 
:J >>; 2 performed based on parameters calculated non-recursively . 

H» 1 15. The method of claim 1, wherein said illumination 

2 estimation is generated based on maximum likelihood. 

1 16. The method of claim 1, wherein said illumination 

2 estimation is generated based on linear minimum mean square 

3 error. 

1 17. The method of claim 1, further comprising: 

2 utilizing a soft decision rule for preventing error 

3 accumulation due to slow motion. 
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1 18. The method of claim 17, wherein said threshold value 

2 is characterized by a first range of values and a second 

3 range of values that include said first range of values, 

4 wherein said first range of values is characterized by a 

5 first constant parameter mi and said second range of values 

6 is characterized by a second constant parameter m 2 where 0 < 

7 mi < m 2r and wherein m lr m 2r and length of global exposure 

8 time are chosen so to achieve a desirable balance between 

9 highest possible signal-to-noise ratio and least possible 

10 motion blur. 

li i 19. The method of claim 18, wherein step c) further 

yp 2 comprising: 

*| 3 cl) indicating no motion/saturation has occurred and 

Bl 4 updating said illumination estimation with said 

^ 5 illumination measurement, if said difference falls within 

6 said first range of values; and 
"y, 7 c2) indicating motion/saturation has occurred and, 

gf 8 1) if said difference falls outside said second 

9 range of values, terminating said performing act 

10 and using said illumination estimation for 

11 generating an optimal illumination estimation for 

12 said sensor; and 

13 2) if said difference falls between said first 

14 range of values and said second range of values, 

15 deferring terminating said performing act and 

16 updating said illumination estimation with said 

17 illumination measurement. 
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22. A method for synthesizing from multiple captures high 
dynamic range motion blur free images, said method 
comprising the steps of: 

a) capturing a first image sample; 

b) generating for each pixel a current illumination 
estimation based on said first captured image sample; 

c) capturing a next image sample; 

d) determining for each pixel whether 
motion/saturation has occurred and whether to include said 
next image sample; 

e) repeat steps c) and d) until no more image 
samples are to be captured. 

23. The method of claim 22, wherein said step d) further 
comprising: 

dl) if motion/saturation has occurred, using said 
current illumination as final illumination estimation; and 

d2) if no motion/saturation has occurred or a 
decision is deferred, including said next image sample and 
updating said current illumination. 

24. A system having a sensor capable of capturing a 
multiplicity of image samples during a global exposure 
time, comprising: 

motion/saturation detecting means for determining for 
each pixel whether motion/saturation has occurred between a 
previous capturing and a current capturing; 

processing means for determining for each pixel 
whether to accept an image sample captured during said 
current capturing; 
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10 estimating means for generating an optimal 

11 illumination estimation for said sensor based on 

12 selectively accepted multiplicity of image samples captured 

13 during said global exposure time thereby preventing 

14 motion/saturation from corrupting image capturing. 

1 25. The system of claim 24, further comprising: 

2 means for determining for each pixel a difference 

3 between an illumination measurement obtained during said 

4 current capturing and an illumination estimation generated 

5 during said previous capturing; 

o 

\7i6 means for comparing for each pixel said difference 

7 with a threshold value; 
fy 8 means for updating for each pixel said illumination 

% 9 estimation with an accepted or deferred illumination 

Clio measurement; and 

means for outputting for each pixel a final 

f*l2 illumination estimation. 

Q l 26. The system of claim 25, wherein said threshold value 

*** 2 is generated based on a predetermined parameter and a 

3 prediction variable, said predetermined parameter is 

4 configured to achieve desired tradeoff between signal-to- 

5 noise ratio and motion blur. 

1 27. The system of claim 25, wherein said threshold value 

2 is characterized by a first range of values and a second 

3 range of values that include said first range of values, 

4 wherein said first range of values is characterized by a 

5 first constant parameter mi and said' second range of values 

6 is characterized by a second constant parameter m 2 where 0 < 
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mx < m 2r and wherein m lf m 2 , and length of global exposure 
time are chosen so to achieve a desirable balance between 
highest possible signal-to-noise ratio and least possible 
motion blur 

28. The system of claim 27, further comprising: 
a soft decision means for preventing error 

accumulation due to slow motion, said soft decision means 
indicating no motion/saturation has occurred and 
updating said illumination estimation with said 
illumination measurement, if said difference falls 
within said first range of values; 

indicating motion/saturation has occurred and 
outputting said illumination estimation as said final 
illumination estimation, if said difference falls 
outside said second range of values; and 

indicating motion/saturation has occurred and 
said illumination measurement is deferred, and 
updating said illumination estimation with said 
deferred illumination measurement, if said difference 
falls between said first range of values and said 
second range of values. 

29. The system of claim 24, wherein each pixel's effective 
exposure time is adaptive to its own lighting condition 
thereby enabling performing for each pixel independently of 
other pixels' • lighting conditions. 

30. The system of claim 24, wherein each pixel is capable 
of terminating its own exposure time thereby enabling 
extending said global exposure time. 
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31. The system of claim 30, wherein said global exposure 
time is limited by motion and saturation only thereby 
enabling said sensor to achieve higher signal-to-noise 
ratio and dynamic range. 

32. The system of claim 24 , wherein said motion/saturation 
detecting means utilizes parameters calculated recursively. 

33. The system of claim 24, wherein said motion/saturation 
detecting means utilizes parameters calculated non- 
recursively . 

34. The system of claim 24, wherein said estimating means 
is characterized as recursive. 

35. The system of claim 24, wherein said estimating means 
is characterized as non-recursive. 

36. The system of claim 24, wherein said estimating means 
is configured based on maximum likelihood. 

37. The system of claim 24, wherein said estimating means 
is configured based on linear minimum mean square error. 

38. The system of claim 24, wherein said motion/saturation 
detecting means and said estimating means are implemented 
based on a self-reset pixel architecture. 

39. The system of claim 38, wherein said self-reset pixel 
architecture utilizes self-reset digital pixel sensors. 

40. The system of claim 24, wherein said system is 
implemented on a single chip. 
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41. The system of claim 24, wherein said sensor is a 
digital pixel sensor. 

42. The system of claim 24, wherein said sensor is a 
photodiode and said illumination measurement represents a 
charge accumulated from photocurrent produced by said 
photodiode . 
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